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This study sought to assess the effects of 
psychological warm-up on the verbal creative thinking abilities of 
first-grade children. The subjects were 96 black firsts-grade children 
enrolled in two schools in Athens and Atlanta, Georgia. Both schools 
are located in poor neighborhoods. Children were randomly assigned to 
control, physical warm-up, and physical and verbal warm-up groups. 
Multivariate analyses of variances yielded no significant differences 
among the groups for verbal fluency, verbal flexibility, and verbal 
originality scores. The standard administration procedures of the 
Torrance tests were as effective as psychological warm-up in 
facilitating creativity test perf orinance. Since the creativity tests 
have been criticized for their test-like atmosphere, the present 
findings and earlier studies would appear to counter the hypothesis 
tiiat a game-like assessment context is necessary to facilitate test 
performance and/or to obtain "true" test measures of creative 
thinking abilities. A recent reappraisal of research evidence 
suggests that the discordant results may have been the result of 
several erroneous assumptions, particular ly as they relate to the 
presumed creativity-intelligence distinction. (Author/JM) 
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Effects of Assessment Contexts on the Creativity Test Performance 

of iJiacKuniiaren 

Nicholas C. Aliotti 

Despite Its methodological shortcomings (Crcnbach, 1968; Guilford, 
1972) the pviblication of Wallach and Kogan's Modes of Thinkin p; in founfi 
Children stimulated a rounher of studies of the role of assessment contexts 
in the measurement of creative thinking abilities. The basic premise 
was simple. If the assessment context provided for a warm, permissive, 
game-like atmosphere, a creativity dimension defined by high inter-test 
correlations and separate from an intelligence dimension would emerge • 
Thus, Wallach and Kogan (1965) concluded that a serious limitation of 
attempts to measure creative thinking abilities was the employment of 
administrative procedures such as time limits, a test atmo.sphere and 
other stresses. Using a play-like atmosphere and no time limits Wallach 
and Kogan found ti*au creativity, defined as the ability to produce many 
associates and many that are unique, was independent of intelligence as 
assessed by traditional methods. Furthermore, it was implied that the 
game-like assessment contest would enhance performance and result in a 
more valid assessment of creative thinking abilities. 

Follov7ing this lead Boersma and O' Bryan (1968) argued that a unified 
dimension of creativity separate from intelligence would emerge in a 
testing situation relatively free from the coercion of time limits and 
knov/ledge that behavior was being evaluated. It was also hypothesized 



- 2 - 

that the *'gaine-liice'' assessment context uould result in an increased 
level of creativity test performance and it was further expected that 
the relationship between intelligence and creativity would decrease 
under this condition. Forty-six Canadian boys were randomly assigned 
either to a standard (classroom) test administration or a "game-like" 
condition consisting of unrestric tive play with sports equipment, a 
visit to a swimming pool, and opportunities to play with toys. Sub- 
sequently, boys assigned to the 'game-like*' condition v;ere tested and 
scored significantlv higher on tv70 Torrance tests > Figure Completion, and 
Unusual Uses. Moreover, inspection of the correlation coefficients 
betv;een measures of intelligence and creativity revealed that the rela- 
tionships between these measures were markedly reduced in the experi- 
mental condition. Consistent replication of such findings, hox^ever, 
have not always been reported. 

In Sherwood's dissertation (1970) eighty sixth grade boys were 
equally divided betvjeen two assessment contexts and administered 
Wallach-Kogaa type tests. In the test-oriented condition the E re- 
ferred to the tasks as tests » made references to tiining, prominently ciiS 
played a stopwatch, and provided contextual remarks consistent with 
procedures associated with intelligence and achievement testing. In 
the other condition^ the E introduced himself as a person interested in 
determining what games children were interested in, described the tests 
as games, avoided any mention of time pressure, and in general induced 
a relaxed atmosphere. Regardless of assessment contexts, the creativity 
measures were substantially intercorrelated and interdependent of the 
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scores obtained on a group intelli^once test. Neither the restrictive 
nor the permissive assessment contexts effected ideational fluenc^r. 

In a highly related study, KoF^an and ^'ormr) (lOop) contrasted a test- 
like and a f^ane-like assessment context. The S_s irere 10m fifth ftrade 
children. The forr.ier condition involved a presumed representBtive of the 
school superintendent who introduced Wallach-Ko^nran tasks as ability tests 
and prominently displayed a cloclr for timinp;. The latter situation r)re- 
sented a presinned representative of a toy company who introduced the 
tests as {^ames. The predicted superiority of the garae-liko assessment 
context did not obt£x:>^ in fact, the test-lilce assessment context resulted 
in significantly higher performances in the case of the alternate uses 
test , 

In general, studies of assessment contexts have paralleled the 
equivocal findings above and have been researched with resr»ect to time 
limits (Torrance, 19^9; Khatena, 1971; Feldhusen et al . , 1971; 
Van ^-bndfrans et al • , 1971), music (Norton, 1<^70- Hooper & Povell, 1^71), 
evaluation set (Edwards, 1970; V/arren and Luria, lf>7P), situational 
variables precedin^:^ testing (Elkind et^ al . , 1^70), cue-rich vs. cue^-DOor 
test environment (Mohan, 1970; P^ohan Cuptaj 191?^) and {7ame-like, relaxed, 
etcetera vst standard administration (Wallach ?- Ko^an, 1^^5; Boersma 
O'Bryan, I968; Aliotti, 1969; Kogan ^ Morgan, 19^9; Feldhusen et al . , 1971; 
Van Mondfrs'jas et al • , 1971)- Table 1 summarizes the results of these and 
similar studies of assessment contexts. A reviev of such studies is 
available in VJallach (1971) and Torrance (1972). 

A second rationale for studying assessment contexts, and a more 
significant impetus to the present study, -vras developed from an increased 
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awareness in recent years of important issues in test measurement ^rhich 
are raised when various minority children are tested. TJnti]. such issues 
are resolved, xnappropriate testing: of these populations \-rill lively 
result in social injustices involving denial of educa^.onal opportunity, 
inappropriate ).Lacement, and the like. Thus, the deyeloment of 
appropriate assessment procedures for testing minority-poverty populations 
remains as an important testing issue. Field observations during the 
author's graduate training, for example, indicated that r>oor hlac^ children 
rarely asked questions to find out something, showed considerable dif- 
ficulty in elaborating an idea, preferred the familiar, avoided new or 
difficult tasks, were afraid to dream, and the like. Moreover, confirming 
the observations of Taba and Klkins (19^6) many of these children expressed 
awe and fear vhen confronted ^ri. th creativity test booklets. Still other 
children quickly "ran out of gas" and com-olained that they were fatigued 
after completing two or three of the seven verbal creativity tasks. 

In 1968 the author was enrolled in a p;raduate course concerned with 
learning problems of disadvantaged children and youth taught by Dr. E. Paul 
Torrance. In order to provide students with a meaningful laboratory 
experience, the course included a three-week, creativity workshop conducted 
in a poor 5 black neighborhood. The emphasis of the workshop was the 
identification and development of creative talent. A description of the 
program is available elsewhere (Torrance & Torrance, 1972). In order to 
uncover the hidden verbal abilities of these children, three procedures 
were employed before any testing was conducted: l) tests were not given 
until there had been time for the creative processes of the children to 
become warmed up, 2) tine limits were not imposed, and 3) the examiners 
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offered to record the children's ideas. These procedures proved to he 
quite effective and the children were ohseWed to he remarkably verbal 
in the testing situation. The workshop format seemed to free them and 
make them more open and receptive to this educational intervention. 
These findings take on even more significance when it is recalled that 
while disadvantaged children have perfonned rather well on figural tests 
of creative thinking ability (Goldman and Torrance, 19^7), even in formal 
situations 5 their performance on the verbal measures has been quite poor. 
These findings are consonant with the considerable research findings 
which have docmented the generally poor test performance of disadvantaged 
children on most verbal tasks as compared to their advantaged counter- 
parts. The present study sought to assess the effects of psychological 
warm-up on the verbal creative thinking abilities of first grade children. 

SITBJECTS 

The Ss_ were 96 black first grade children (Males = Ul, Females = 55) 
enrolled in two schools in Athens and Atlanta, Georgia. The mean age of 
the Ss was 6 years, 11 months. Both of these schools are located in poor 
neighborhoods, and the children are representative of a minoritv cul.ture 
in the southern United States. 

PROCEDURES 

To study the efficacy of psychological warm-up, a posttest only 
control group design was employed. Ss^ were randomly assigned within sex 
to one of three treatment groups. On the first day Ss, assigned to the 
control condition were individually administered Verbal Form B of the 
Torrance Tests of Creative Thinking (Asking Questions , Guessing Causes, 
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Guessing Consequences, Product Improvement , Unusual Uses, Unusual Questions, 
Just Suppose) "by a teain of exsmners in accordance with the standard 
administration procedures descrihed in the noms-technical manual. Ss^ 
assigned to the physical varm-ur) (group tT/'o) and physical and verbal 
warin-UT) conditions (rrou-n three) received identical fort"''- minute physical 
vrarm-up consisting of magic demonstrations, creative movement to music 
(e.g. 5 'Mafic Net^' technique, Torrance, 19^^9)5 and interpretative soul 
dancing to a record by Diana Ross and the Supremes. The following?: day 
the first .physical varm-up group ims' tested vhile the second physical 
varm-up group received an additional forty minute warm-up session desif^ned 
to encourage verbal associating, question-asking skills, ma>inr guesses, 
and interpreting visual and tactile stimuli. Finally, on the third day 
this group vas tested. Each warm-up vas concluded with a ,;Juice and cool^'ie 
refreshjnent period. 

RESULTS 

To test the hypothesis of the effectiveness of psychological varm-u-o, 
a 2 X 3, fully crossed, tTTo--way analysis of variance with treatment and 
sex as the independent variables was conducted. In addition, analyses of 
these variables Mere conducted for each school in which the study was 
conducted. The dependent variables consisted of the verbal fluency, 
flexibility, and originality scores for the total battery and each of the 
seven tasks which compose the verbal Torrance test. Since the data were 



Note: It would, of course, have been Dreferable to have tested all Ss 
immediately after the warm-up. However, since the verbal Torrance tests 
take a minimum of forty-five minutes to complete, the lop^istics of such 
an endeavor made this alternative highly prohibitive. 
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multivariate in form, a multivariate analysis of variance was comiMXterl. 
Table 2 reports the results of the combined verbal fluency, verbal flexi- 
bility, verbal originality scores for ninety-six black first ^2:rade 
children. 

Insert Table 2 about here 

Inspection of the likelihood ratio test statistic (chi-square) and 
the F ratio test statistic indicated that significant treatment, sex, 
or interaction effects did not obtain. Additionally, analvsis by school 
did not indicate a different interpretation of the results. The experi- 
mental vann-up treatments vere no more facilitative of test performance 
than the standard test administration. An inspection of the means and 
standard deviations for each school considered separately j hovrever, 
suggests some moderation of the conclusiveness of these findinf^s. 

Table 3 reports the means and standard deviation for the verbal 
fluency, flexibility, and orii^inality scores from the Torrance test for 
the Athens 5 Atlanta, and total school samples. 

Insert Table 3 about here 

A perusal of the means for each treatment, for example, indicated 
that in the Athens School the mean performance of Ss_ in the varm-up 
treatments did indeed surpass the performance of the control Ss. The 
results were particularly clear for the verbal fluency and verbal origin- 
ality scores. The ordered means were 30.80, 39. 6U, and U3.95 for verbal 
fluency and 15.30, ?U.21, 2^.0? for verbal originality for the standard 
administration, physical warm-up, and physical and verbal warm~ut) 
conditions, respectively. A similar trend obtained for the verbal 
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flexibility score althouf^h the differences amon^ treatment means was 
small. Iwere is a strong suggestion in the data that larf^e within grouns 
variability and small sample size precluded a rejection of the null 
hypothesis of no treatment, effects. 

The standard administration procedures of the Torrance tests were 
as effective as psychological varm-up in facilitating creativity test 
performance. Since the creativity tests have been criticized for their 
test'-like atmosphere (Wallach & Kof^an, 1^6?:, Wallach, 1971), the present 
findings and earlier studies would appear to counter the hypothesis that 
a game-like assessment context is necessary to facilitate test -perfor- 
mance and/or to obtain ^^true^' (i.e., orthogonality wj.th intelligence 
tests) test measures of creative thinking abilities. A recent reappraisal 
of research evidence suggests that such a hypothesis may not he tenable 
(Wallach, 1971). The discordant results may have been the result of 
several erroneous assumptions, particularly as they relate to the pre- 
sumed creativity-intelligence distinction. Interestingly 9 VJallach & 
Kogan (1965) rejected conclusions from studies v/hich had demonstrated 
low correlations between measures of divergent production and traditional 
measure of intelligence. Guilford & Hoepfner (19^6), for exajnrjlej 
reported an average correlation of .32 between forty-five divergent 
production (DP) tests and IQ, a finding consistent with earlier studies 
employing a full range of IQs in their research samples. Torrance (19^8) 
reported that the /e^dian of 88 coefficients of correlation between measures 
of intelligence and verbal creativity was .21. 
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The saliency of investif^ation of assessment contexts on this premise 
is questionable. First, such research focuses interest on creativity 
test performance per se rather than the relationshlt) het^-^een test perfor- 
mance and socially valued criteria of creativity. Research directed 
toward establishing the external criteria against T-rliich creativitv test 
performance can be evaluated still remains a primary research need. 
Secondly, uhile the creative process is often characterized by periods 
of play and relaxation, it is even more typically characterized by 
deliberate and concerted efforts and rather high levels of mental energy. 
In developing creativity measures care rmst be taken to include essential 
attributes of what is knoxm about the creative pexces^* Covinp;ton (in press) 
has argued that creativity tests are often characterized by psychometric 
procedures vhich present artificial and contrived situations. For example, 
Covington has stated that the creative process ^^is usually characterized 
by intense personal involvement in one real problem, over a -neriod of time, 
vith an emphasis on ordering a problem, coordinating or manap:infr one's 
effort, and attaining a solution" (Treffinger /?? Poggio, 1^12 ^ P- ^'55). 
Guilford (1971 ) has also warned against an over-investment in ''divergent 
thinking" tasks in the development of conceDtualizations of the creative 
process. Similarly, changes in test conditions, such as variations in 
working time, test instructions, administrative procedures, incomplete 
or partial sampling of tests, and the like reduce comparability among 
research findings* Thus, performance differences are often confounded 
and one is unable to determine if subject scores are attributable to such 
changes or to individual differences in the test itself. 
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Creativity researchers might better address such questions as 
alternative procedures for sampling creative behaviors than suggest that 
assessment contexts may make creativity tests more or less valid. The 
development of more adequate norms, for example, might be profitably 
explored. Some preliminary research (Torrance, ^ 1971 ) suggests 

that creativity tests allov subjects to respond in terms of their ovm 
unique experiences and hence are less susceT)tible to the effects of 
schooling. Research directed toward developing adequate normative data 
of various ethnic, cultural, and geographic groups and the development 
of ''profile'' norms vould help dispel the mystic of creative functioning 
and contribute to an expanded and more realistic vie*^.^ of giftedness. 



Table 1 

Summary ui Experiments Involving Assessment Contexts in the Measurement of 

Creativity 



Investigator 



Grade 
Level 



Nature of Treatment 



Significa^it (.05) 
Differences 



Aliotti (1969) 



Boersma & 

0' Bryan (1968) 

Edwards (1970) 



Elkind et al, 
(1970) 



Feldhusen et^ al . 
(1971) 

Hooper & Powell 
(1971) 

Khatena (1971) 



Kogan & 

Morgan (1969) 



Mohan (1970) 



Mohan & 
Gupta (1972) 



Nash (1971) 



1st 
Disadv. 



4 th 
Boys 



6 th 



5-12yr. 



5 th 
8 th 

1st 
3rd 

10th 



5 th 



4 th 



5 th 



1st 
Disadv • 



Standard vs. warm up day Torrance Verbal- 
prior to testing not significant 



Standard vs. relaxed 



Relaxed s Torrance tests 



Evaluated vs. non-evaluated Evaluated: Higher 

scores on Wallach- 
Kogan tasks 

Interruption of interest- Uninteresting: Wallach- 
ing vs» uninteresting Kogan tasks 

task before testing 

Standard, incubation, take Standard: highest score 



home , game-like 

Absolute music vs. pro- 
grammed music 

Variation in time limits 
for response 



Test-like vs. game-like 
(timeH) 



Cue-rich and cue-poor 
testing room 



Cue-rich and cue-poor 
environment 



on Torrance verbal 

Absolute music ; 
Torrance tests 

Increased time for in- 
cubation j increased 
originality, Torrance 
tests 

Game-likes higher 
fluency and unique 
responses, IJallach 
tests 

Environment ^helped high 
creativds more than • ^ 
lowScreatives 

Environment : higher 
combined score , Torrance 
verbal 



Warm-up Immediately prior Torrance figural 
to testing 



Norton (1971) 



6th 



Music 



No significant differ- 
ence, Torrance tests 



Table 1 continued 



Sherwood (1968) 



Torrance (1969) 



Towell (1972) 



Vernon (1971) 



Ward (1969a) 



6 th 
Boys 

6 th 



4 th 



Van Mondfrans at al« 5th 
(1971) 8th 



8th 



Nurs . 



Ward (1969b) 



Warren & 

Luria (1972) 



7-8yr, 



5 th 

6 th 



Test-oriented vs, relaxed 



Take home after timed 
adminis tration 



Untimed 



Standard, incubation, take 
home, game-like 



Standard vs» relaxed, in- 
formal, relatively 
untimed 

Cue-poor vs. cue-rich 
environment 



Succesive time •peri6ds\ 



Decregsirig .ev^lua£ional 
set 



No significant effects 3 
ideational fluency 

Take home more valid 
for teacher curiosity 
nominations , Torrance 
tests 

No significant incre- 
ment, Torrance tests 



Take home: scores that 
fit best concept of 
creativity as unitary 
factor orthogonal to 
IQ, Torrance tests 

Relaxed: higher scores 
Torrance, Wallach- 
Kogan tests 

No significant environ- 
ment effect, Wallach- 
Kogan tests, creatives 
profit more cue-rich 

Increased uncommoness 
V7ith time, Wallach- 
Kogan tests 

No significant effects 
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Ta'ble 2 



Results of the Multivariate Analyses of Variance for First Orade Black Children 
on the Comhined Verbal Fluency, Verbal Flexibility, and 
Verbal Originality Scores from the Torrance Tests 
of Creative Thinking 
N = 96 



Souarce of Variation 


df 




F-Ratio or 
F-Ratio 


Chi- square 


Subtotals (Treatment and Sex) 
Interaction (Treatment X Sex)* 
Main Effects (Treatment) 
Main Effects (Sex) 


3/88 


15 
6 
6 


.23 


9. lit 
5.7if 


Subtotals (School and Sex) 
Interaction (School X Sex) 
Main Effects (School) 
Main Effects (Sex) 


3/90 
3/90 
3/90 


9 


1.2?. 
.80 
.12 




Subtotals (Treatment and School) 
Interaction (Treatment X School) 
Main Effects (Treatment ) 
Main Effects (School) 


3/88 


15 

C-. 
6 


.77 


15.07 
7.0U 
5.k^ 



^Unable to compute due to non-gramian matrix. 
Note: All tests were nonsignificant (p>.05). 
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Means and Standard Deviations for Verbal Fluencv, Verbal l^lexibility 
and Verbal Originality Scores on the Torrance Tests of 
Creativity Thinkinp; by School and Treatment 



-30 



^ 20 



.10 



Verbal 
Fluency 



Verbal 
Flexibility 



Verbal 
Originality 



W=58 



Athens 
N=38 





Cont. 


Phys. 


Hiys . 


Cont . 


Phys. 


Phys . 


Cont . 


Phys. 


Phvs . 








Verb. 






Verb . 






Verb. 




23 


16 


19 


23 


16 


19 


23 




19 


X 


1+7.8 


UO.2 


Uo.l 


20.5 


19.2 


19.3 


23.8 


2h.B 


23.9 


SD 


25.7 


23.8 


lU.O • 


9.2 


8.6 


5.2 


17.3 


17.9 


13.0 


N 


10 


lU 


lU 


10 


Ih 


lU 


10 


Ih 


lU 


X 


30.8 


39.6 


U3.9 


17.9 


17.'* 


17. h 


15.3 


2h.2 


22.0 


SD 


9.0 


16.8 


23.3 


5.6 


5.h 


7.2 


9.1 


15.1 


IU.5 
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